S&H Form: PT0/SB/Q5 (12/97) 



UTILITY 
PATENT APPLICATION 
TRANSMITTAL 

iOniv for new nonprovisional aooHcations under 37 CfR 1.53(b)) 



Attorney Docket No. 1364.1007 



O 

Jfci. 



First Named Inventor or Application identifier: 
Rafael HEREDIA 



54 4 



Express Mail Label No. 



0 

— 



APPLICATION ELEMENTS 

See MPEP chapter 600 concerning utility patent 
application contents. 



ADDRESS TO: Assistant Commissioner for Patents 

Box Patent Application 
Washington, DC 20231 



1 . [X] Fee Transmittal Form 

2. [X] Specification, Claims & Abstract [ Total Pages: 25 ] 

3. [X] Drawing(s) (35 USC 113) [ Total Sheets: 14 ] 

4. [ ] Oath or Declaration [ Total Pages: ] 

a. [ ] Newly executed (original or copy} 

b. [ ] Copy from a prior application (37 CFR 1 .63(d)) (for continuation/divisional with Box 17 completed) 
i. [ ] DELETION OF INVENTORCSl 

Signed statement attached deleting inventor(s) named in the prior application, 
see 37 CFR 1.63(d)(2) and 1.33(b}. 

5. [ ] Incorporation by Reference {usable if Box 4b is checked) 

The entire disclosure of the prior application, from which a copy of the oath or declaration is supplied under 
Box 4b, is considered as being part of the disclosure of the accompanying application and is hereby 
incorporated by reference therein. 

6. [ ] Microfiche Computer Program (Appendix) 

7. [ ] Nucleotide and/or Amino Acid Sequence Submission (if applicable, all necessary) 

a. [ ] Computer Readable Copy 

b. [ ] Paper Copy (identical to computer copy) 

c. [ 1 Statement verifying identity of above copies 

ACCOMPANYING APPLICATION PARTS 

Assignment Papers (cover sheet & document(s)) 

37 CFR 3.73(b) Statement (when there is an assignee) [ ] Power of Attorney 
English Translation Document (if applicable) 

Information Disclosure Statement (IDS)/PT0-1 449 [ ] Copies of IDS Citations 

Preliminary Amendment 

Return Receipt Postcard (MPEP 503) (Should be Specifically itemized) 

Small Entity Statement(s) { ] Statement filed in prior application, status still proper and desired. 
Certified Copy of Priority Document (s) (if foreign priority is claimed) 
Other: 



8. 


I ] 


9. 


[ ] 


10. 


[ 1 


11. 


[ 1 


12. 


[] 


13. 


[X] 


14. 


[ ] 


15. 


[] 


16. 


[ ] 



17, If a CONTINUING APPLICATION, check appropriate box and supply the requisite information: 
[ ] Continuation [ ] Divisional [ I Continuation-in-part (CIP) of prior application No: 



18. CORRESPONDENCE ADDRESS 



STAAS & HALSEY LLP 

Attn: Richard A. Gollhofer 

700 Eleventh Street, N.W., Suite 500 

Washington, DC 20001 



Telephone: (202)434-1500 
Facsimile: (202)434-1501 



1997 Staas & Halsey 



W:\13S4\1007\UTIL-TML.wpd 



1364.1007 



APPARATUS, METHOD AND DATABASE 
FOR CONTROL OF AUDIO/VIDEO EQUIPMENT 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to U.S. Patent Application Serial No. 09/002,721, 
5 filed January 5, 1998 by Martin R. Wachter, entitled "Automated Control of 
''^ff Electronic Devices;" U.S. Patent Application Serial No. 09/060,876, filed April 15, 

tf| 1998 by Dale Tyson Roberts, et al. "entitled Network Delivery of Interactive 

^ Entertainment Complementing Audio Recordings" which is a continuation-in-part of 

f j U.S. Patent Application Serial No. 08/838,082, filed April 15, 1997 by Dale Tyson 

Ul 10 Roberts, et al. entitled "Network Delivery of Interactive Entertaiiunent Synchronized 

to Playback of Audio Recordings," now U.S. Patent No. 5,987,525; and U.S. Patent 
111 Application Serial No. 09/227,086 filed January 5, 1999 by Scott A. Jones et al. 

^ entitled "Playback Device Having Text Display and Communication with Remote 

t y 

Database of Titles", all incorporated herein by reference. 



15 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention is directed to control of audio and video equipment and, 
more particularly, to use of a computer in a device having the capabilities of an 
audio/ video receiver. 



20 Description of the Related Art 

Many type of consumer electronics audio/video equipment have been 
introduced in recent years and more are expected in the near future. There are a 
number of format for recording or playing back recorded signals, whether they be 
audio-only or video with audio, such as compact discs (CD), digital versatile discs 

25 (DVD), video cassette tapes of several types and audio tapes of several types. 
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Additional formats and devices to play back and sometimes to record audio using the 
new formats continued to be introduced. In addition, there are numerous formats for 
recording both audio and video signals in computer mass storage some of which are 
beginning to approach and sometimes surpass the quality of broadcast signals and 
recorded formats. There are also numerous types of broadcast signals transmitted 
from ground-based antennas, satellites, and cable systems. New formats, 
transmission modes and devices to produce audio and video images therefrom 
continued to be introduced. However, there have been few advances in the control 
systems for such devices to simplify the use of such equipment. 

Recently, some devices have begun to use on-screen menus and guides to 
simplify the programming and selection of content. Examples include VCR plus 
video cassette recorders, and satellite television receivers. Devices such as 
TuneBase® provide computer control of CD changers including title, track, and cover 
art information displayed on a computer monitor and television screen. 

More recently, the audio and to a lesser extent video capabilities of personal 
computers have expanded to include streaming signals received via a network, 
buffered and reproduced, thereby not requiring large amoimts of storage, and 
compressed formats such as MPEG Layer 3, that can be reproduced with a quality 
between that of FM broadcasts and compact discs. There are also computer cards that 
can be added to a personal computer to provide a radio or television tuner, video or 
output to television monitors and sound and video processing capabilities for digital 
Dolby® and MPEG-2 video. 

There have been several attempts to package devices including such 
components. Examples include the Philips DVX 8000™ which had audio components 
outside of the personal computer and the Gateway Destination™ which output 
computer video in, e.g., VGA format, to a large screen computer monitor. In 
addition, computer mass storage is used to store video signals not only by 
conventional computers, but also by devices such as TiVo™ and Replay TV™ which 
include television programming guides. 

Attempts are being made to make consumer electronics more intelligent using 
JINI™ from Sun® Microsystems and Home Audio Video Interface from Sony®. 
However, there are no known systems that are effective in providing a powerful and 
simple control system for audio and video devices. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an audio/visual receiver with 
sophisticated computer programming. 

It is another object of the present invention to combine playlists of audio 
5 recorded on discs and tapes with files in computer mass storage. 

It is a further object of the present invention to reproduce audio from muhiple 
forms of recorded signals using playback preferences, including digital signal 
processing for surround sound effects, for entire discs, individual tracks and files in 
computer mass storage. 
10 It is yet another object of the present invention to play back recorded signals 

on digital versatile discs using playback preferences of at least one of audio and video 
formats saved from a previous use of the digital versatile disc. 

It is a still further object of the present invention to provide an audio/video 
component able to switch audio and video separately and route or mix audio signals, 
15 from multiple inputs to multiple outputs. 

The above objects can be attained by a method of playing back a recorded 
signal, including obtaining a recording identifier corresponding to the recorded signal; 
comparing the recording identifier with previously stored identifiers in a playback 
preference database; and reproducing the recorded signal using previously stored 
20 preferences if the recording identifier is found in the playback preference database and 
using default preferences if the recording identifier is not found in the playback 
preference database. 

Preferably, the database stores information on at least one of audio and video 
formats, such as surround sound mode, language of audio m the recorded signal, and 
25 video output format when the recorded signal is on a digital versatile disc. The 

previously stored preferences are obtained during a previous playback of the recorded 
signal. Preferably, the database also stores play list records with a play list identifier 
for each playlist; an order within the playlist for a recorded signal; a disc identifier 
when the recorded signal is obtained from a digitally encoded disc; a filename when 
30 the recorded signal is obtained from a digitally encoded file on a mass storage device; 
and the playback preferences for the recorded signal. 

The above objects are also be obtahied by a method of controlling audio/video 
equipment, including selecting a first source from among inputs including at least two 
of a computer file, a computer data connection, a digitally encoded disc player, a 
35 radio tuner, a television audio decoder, an MPEG decoder, a S/PDIF input, a 
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microphone, an external video signal and an external audio signal; selecting a first 
output for the first source from among outputs including a computer mass storage 
device and at least one of speakers, headphones, an audio tape device, and a video 
tape device; and routing the first source to the first output. The inputs can also be 

5 routed or mixed to others of the available outputs simultaneously by switching and 
multiplexing circuits. Preferably a graphical user interface is used in performing this 
method of controlling audio/video equipment. 

These together with other objects and advantages which will be subsequently 
apparent, reside in the details of construction and operation as more fully hereinafter 

10 described and claimed, reference being had to the accompanying drawings forming a 
part hereof, wherein like numerals refer to like parts throughout. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a system according to the present invention. 
Figure 2A and 2B form a block diagram of an audio subsystem in the system 
15 illustrated in Fig, 1. 

Figures 3A and 3B are database record structure diagrams. 
Figure 4 is a data class object interface diagram. 

Figure 5 is a plan view of a remote control for use with a system according to 
the present invention, 

20 Figures 6A-6H are display screens of the user interface that controls a system 

according to the present invention. 

Figure 7 is a flowchart of operation of a system according to the present 
invention. 

Figure 8 is a flowchart of playback of recorded signals according to the 
25 present invention, 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Illustrated in Fig. 1 is a block diagram of a system 20 according to the present 
invention. The system 20 has an overall construction of a computer with audio 22 and 
video 24 subsystems. The usual computer components of a CPU 26, RAM 28 and 
30 mass storage (hard disk) 30 are connected by main bus 32, In Fig, 1, the common 
IBM personal computer northbridge 34 and southbridge 36 structures are also 
illustrated, but the present invention is not limited to this computer architecture. In 
addition, computer network connections 38 are provided, such as a local area network 
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connection 40 and modem 42. A high speed device interface 44, such as IEEE-1394, 
is also connected to main bus 32, to provide a connection to components such as 
removable disc drive 46 for reading digital versatile discs, compact discs, etc., and 
additional external devices at ports 48, 50. 
5 In Fig. 1 some of the major components of the audio subsystem 22 are 

illustrated, with additional details provided in Fig. 2. The components illustrated in 
Fig. 1 include AM/FM tuner 52 and a programmable analog mixer 54, such as an 
AC97 codec available for many chip manufacturers; one example is Crystal 
Semiconductor CS4297A. Also illustrated in Fig. 1 are decoders 56 of several types 
10 including Sony-Philips digital interface (S/PDIF), analog/digital converters and 

digital/analog converters, as described in more detail below. Digital signal processor 
58 performs processing of audio signals, e.g., to provide surround sound effects such 
as hall, stadium, club, church, etc. Also supported are Digital Dolby, DTS and 
J variable echo, reverberation, loudness, speed and direction. An example of a DSP 

15 chip that can be used is a Crystal Semiconductor CS 4296 

In video subsystem 24, television tuner 60 may be provided by a Philips 
Semiconductor module F1236 MK2-PH or similar device. Video decoder 62 may be 
provided by components such as one or more Video Matrix TEA6425 chips for 
decoding S- video inputs and a peripheral device coupled to main bus 32, such as an 
20 ATI Rage® Theater™ graphics chip or similar graphics component. Encoder 64 and 
decoder 66 for Motion Picture Experts Group (MPEG-2 or ISO 13818) compressed 
digital video, and graphics module 68 may be provided by, e.g., an ATI Rage® 128 
AGP card coupled to graphics bus 70. 

Southbridge 36 provides connection to other peripheral devices through the 
25 universal serial bus (USB) ports to devices, such as an infrared output 72, e.g., a JDS 
IR-XP^, for controlling devices connected to apparatus 20. Other ports 74 are 
provided for devices having other control inputs, such as RS-232, Sony's S-link, etc. 
Additional conventional television components such as a comb filter (e.g., a Philips 
TDA9183T or similar chip for S-video components) may be included in video 
30 subsystem 24. 

A block diagram of the audio subsystem is illustrated in Figs. 2 A and 2B 
which should be combined with Fig. 2A on the left and Fig. 2B on the right. The 
inputs on the left include AM/FM tuner 52 and AC97 codec 54 illustrated in Fig. 1. 
Other input devices include television audio decoder 100 which may be Philips TDA 
35 9850 and MPEG-2 decoder 102, such as an IBM CDIM or Sigma Designs EM8220. 
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Each of the input components 52, 54, 100 and 102 have one or more inputs not shown 
in Fig. 2A. 

The input jacks illustrated in Fig. 2A include front line-in jack (video 3) 104. 
rear line-in jacks 106, 108 for video 1 and video 2, respectively, rear line-in audio 
5 jacks 110, 112 for, e.g., a CD changer and a tape deck, microphone jack 114 and 
S/PDIF input 116. Inputs for additional audio and video devices may also be 
included. In addition, one or more internal connections 120 may be provided for, 
e.g., CD audio headers and other audio from removable media drive 46 (Fig. 1). For 
example, not illustrated in Fig. 2A are connections to the inputs of AC97 codec 54 
10 and MPEG-2 decoder 102 to receive pulse code modulated (PCM) output from 

software that decodes digitally encoded audio files like MP3 files. Either AC97 codec 
54 or MPEG-2 decoder 102 could be used as the input for PCM audio, but MPEG-2 
decoder 102 is preferred so that the signal is converted to analog only once. 

Some of the inputs, such as microphone jack 114 and S/PDIF input 116 are 
15 coimected to processing components, i.e., microphone pre-amplifier 122 and digital 
audio receiver 124, respectively. Digital audio receiver 124 may be a Crystal 
Semiconductor CS8414 which changes the S/PDIF input signal (whether received 
from an optical interface or a coaxial connector) containing, e.g., AC3, DTS or PCM 
digital audio into digital signals matching the clock signal and voltage levels used by 
20 audio subsystem 22. 

5 AC97 codec 54 receives analog inputs from, e.g., rear line-in jacks 106, 108, 

il internal audio line 120, and microphone pre-amplifier 122. In addition, the main 

:{ output (described below) may be fed back to AC97 codec 54 which performs analog 

mixing from the various inputs it receives. The output of AC97 codec 54 is supplied 
25 to three multiplexers, VCR line output multiplexer 130 also receivers inputs from 
front and rear line-in jacks for video 104, 106 and 108; tape line output audio 
multiplexer 132 also receives input from AM/FM tuner 52, television audio decoder 
100, video line-in jacks 104, 106, 108, audio line-in jacks 110, 112, and internal line 
120; and main input audio multiplexer 134 receives the same input as tape line output 
30 multiplexer 132. VCR and tape line output audio multiplexers 130, 132 are directly 
supplied to rear line-out jacks 136, 138. The output from main input audio 
multiplexer 134 is supplied to an operational amplifier 140, such as Motorola 
MC33078 prior to conversion to digital form in analog/digital converter 142, such as 
Crystal Semiconductor CS5334. The digital inputs 102, 116 require no conversion 
35 and are selected or mixed by digital multiplexer 144. 
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The digital output signals from analog/digital converter 142 and digital 
multiplexer 144 are supplied to DSP 58 for digital signal processing to provide 
surround sound effects, etc. Digital/analog converters 146-148 convert the output 
from DSP 58 to analog audio signals. The rear surround signals and 
5 center/ subwoofer signals from D/A converters 146, 147 are supplied to volume 

control circuits 150, 152 and pass through mute controls 154, 156 before being routed 
to rear line-out jacks 158, 160. The subwoofer signal from volimie control 152 is 
supplied to discrete mixer 162 along with the output from D/A converter 148 and 
AC97 codec 54. The output of discrete mixer 162 is supplied to volume control 164 
10 and passes through mute control 166 prior to being supplied to rear line-out jacks 168. 
The output of discrete mixer 162 is also supplied to AC97 codec 54 and audio 
multiplexers 130 and 132 for VCR and tape line outputs. 

Additional multiplexers could be added to provide additional outputs, just as 
^.3 noted above, additional inputs could be provided. In the illustrated embodiment, the 

: S[ 15 audio subsystem provides up to four independent outputs that can be selected from, or 

lij mixtures of, up to 12 input sources. This permits the audio to be selected from an 

} 3 AM/FM tuner or streaming audio obtained from the Internet via modem 42 or 

{ !1 Ethernet connection 40 via AC 97 codec 54, while viewing a related video program, 

such as a sports event or concert. It also permits mixing of audio signals from e.g., a 
20 video camcorder connected to one of the video jacks with music from a CD in 

5 LI 

1:1 removable media drive 46, AM/FM tuner 52, computer files via AC97 codec 54, etc., 

^ ^ or with words spoken into a microphone connected to microphone jack 1 14. In 

'X addition, it is possible to perform multiple tasks simultaneously, such as recording any 

input signal, while at the same tune copying a video tape, and watching and listening 
25 to a DVD or television broadcast. 

Control of audio subsystem 22 and video subsystem 24 is provided by a 
program executing m CPU 26, The control functions performed by the CPU 26 
includes selection and mixing of audio signals. To support these control functions, 
databases are stored in mass storage 30. The structure of databases for recorded audio 
30 and television are illustrated in Figs. 3A and 3B, respectively, as examples of the 

databases maintained by system 20. Additional databases are provided for other types 
of content, such as broadcast and Internet radio, DVDs, etc. 

As illustrated in Fig. 3 A, one of the databases contains playlists of recorded 
audio. Each record in the play list database may include a name assigned to the 
35 playlist, a cover filename for a file used to produce an image associated with the 
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playlist, an artist field identifying the content producer and a genre field identifying 
the type of content. Another table in the database is named playlist-song which is 
mdexed by playlist name and order within the playlist. Other fields in the playlist- 
song table are filename which identifies a file stored in mass storage device 30 

5 containing digitally encoded audio, and disc ID or disc name which are used to 

identify a disc in a disc changer connected to system 20. Either or both of the disc ID 
and disc name may be used to identify the disc and a track number may be identified 
to select one of the tracks on the disc. Audio effects may be specified, such as echo, 
reverberation, loudness, speed and direction for control of DSP 58 and volume 

10 control circuits 150, 152, 164. The filename is not provided if the audio recording is 
obtained from a disc and snnilarly the disc ID, disc name and track number fields are 
not used if the filename is provided. 

Additional tables are provided for all audio discs that have been played by the 
system or inserted into the changer(s) connected to system 20 with the same fields as 

15 provided for each playlist, plus the disc ID. The information about each track on the 
disc is maintained in a separate table with the same fields, except cover filename and 
the additional field length and title. A disabled flag may be included to skip specific 
tracks. A similar table may be maintained for all of the files stored in mass storage 
30, and a table is maintained for genre and subgenre as illustrated in Fig. 3A. 

20 Also illustrated in Fig. 3 A is a table for recordings from external sources 

which require manual intervention to provide the identified recording. Any single- 
play device would fall into this category, such as a tape deck, mini disc deck, etc. 
Portable devices whether using tape, disc, solid state or other memory storage would 
also fall into this category. 

25 At the present time, techniques have been developed for identifying compact 

discs when an industry standard identifiers is not provided. Databases are accessible 
via the Internet to provide information, such as title, artists and genre and to provide 
access to associated images that can be displayed by system 20. However, at the 
present time, the recordings listed in the external source table would require manual 

30 selection of the entry together with manual operations to provide the recording for 
playback. 

Although the table discussed above as identifying files stored in mass storage 
30 is illustrated in the Fig. 3 A as having the name MP3, any audio file may be 
included in the table or separate tables may be used for different file formats. The 
35 software executed by CPU 26 can be used to manually or automatically download 
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programs to playback the files. The filename extension, for example, may be used by 
the operating system to identify the program to be used for playback. 

In addition, new formats are being developed for audio discs, such as super 
CD, DVD audio, etc. These or any other subsequently developed formats that require 
5 or permit additional processing or effects may be handled by a separate table or 
additional records or fields for appropriate control of DSP 58. 

A separate database (not shown) is preferably maintained for DVDs, including 
disc ID, title, video output format and surround sound mode. Additional fields, such 
as angles, language, etc. may be included depending upon what selections can be 

10 made during playback on the discs that are played. When a DVD containing video 
and audio content is, e.g., uiserted into removable media drive 46, an entry in the 
table is generated by the software executing in CPU 26. Associated content, such as 
cover art, may be automatically downloaded from the Internet. As the user goes 
through the menu selection to setup playback of the DVD, the selections are recorded 

15 in the database. As a result, the next time the same DVD is inserted or selected for 
playback, play can begin hnmediately usmg the previously selected formats and 
modes. 

A database is illustrated in Fig. 3B for broadcast television programs. System 
20 is designed to be used with television signals received from land-based antennas, 
20 satellites and cable systems. Information on source of program, rating, beginning and 
ending time or length, payment information for pay-per-view, etc. may all be stored 
in the database. Storing such information enables guides like those described below to 
be displayed. 

Fig. 4 shows the data class object interface of software executing in CPU 26 to 
25 access the databases like those illustrated in Figs. 3 A and 3B. The databases 

maintained by system 20 may be unplemented using Microsoft Access as indicated by 
databases 300 in Fig. 4. MFC API 310 is used to access the databases 300. Separate 
class objects 312, 314, 316 call the MFC API 310. The song class object has at least 
two types, CD track 318 and mass storage file (MP3) 320. There are three radio 
30 station classes AM 322, FM 324 and Internet 326. There is only a single DVD 

chapter class 328. However, there may be other class objects such as video files and 
external source recordings. Collection class object 330 is used to store user-selected 
collections of songs 332, radio stations 334, and television stations (not shown). 
DVD chapters 336 on a DVD are also maintained as a collection. Carousel class 
35 object 340 is used to store all recorded audio in song collection carousel 342; radio 
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stations, whether AM, FM or Internet, in radio station collection carousel 344; and 
DVD chapters of all discs that have been accessed by system 20 in DVD chapter 
collection carousel 346, 

All of the classes may be accessed by dialogs. Illustrated in Fig. 4 are two 
5 player dialogs 350, 352 and corresponding guide dialogs 354, 356. Each player 
dialog corresponds to one of the modes of operation, such as audio player, television, 
radio, etc. and thus, there are more player dialogs than illustrated in Fig. 4. As 
indicated in Fig. 4, there are options dialogs 360, 362, 364, 366 corresponding to the 
player and guide dialogs. These dialogs 350, 352, 354, 356, 360, 362, 364, 366 
10 generate the screen formats described below with reference to the plan view of remote 
control 400 in Fig, 5 and the display screens in Figs. 6A-6H. 

During installation, system 20 is connected to other components, such as 
speakers, CD changer(s), a television monitor, a satellite or cable set top device or 
, ^ receiver, video cassette recorder, etc. Infrared remote control codes for the connected 

15 components are obtained from an internal database, or a database on a recording 
J |[ medmm, or by downloading from the Internet. The Internet connection may be 

Q provided by a telephone line connected to modem 42, a local area network via 

J ^ Ethernet connection 40 and external cable modem or satellite connection, etc. Remote 

control codes available at, e.g., www.ueic.com may be downloaded on an as needed 
20 basis by system 20, or may be distributed on computer-readable media, such as a CD- 
J4 ROM, or otherwise supplied when component(s) are connected to system 20. The 

connected devices can then be controlled using IR output device 72 as described in the 
related application Serial No. 09/002,721. 

Preferably, remote control 400 is used to control system 20. Remote control 
25 400 may be an infrared remote or a radio frequency remote and may have a minimal 
number of buttons as described in related application Serial No. 09/002,721 or have 
buttons in a layout like that illustrated in Fig. 5. In either case, user selections of 
positions on the screen or buttons on remote control 400 are translated by software 
executing in CPU 26 to generate the required internal operations or external 
30 operations communicated by infrared remote control commands or electrical 
connections to the component being controlled. 

When the system 20 is turned on or powered up from stand-by mode, the 
initial screen display may be the control screen for the last controlled component, 
when system 20 is first turned on, system 20 is set up to operate all of the components 
35 connected thereto and system 20 is left in a control mode for one of the components, 



ry 



- 11 - 



1364.1007 



such as a television. The second time that system 20 is turned on the same control 
screen, e.g., a television guide like that illustrated in Fig. 6A is displayed. Using the 
remote illustrated in Fig. 5, it is easy to select another mode from the mode select 
buttons 401-410, 

5 The selection of different modes, i.e., sources of input and output, is depicted 

in the flowchart illustrated in Fig. 7. An initial source of input is determined 710 
from the last controlled component or by pressing one of the mode select buttons 401- 
410. For example, when television is selected, a TV guide like that illustrated in Fig, 
6 A may be displayed 720. Just as the last controlled component determined the initial 

10 source of input, the last output for that source or a default output, such as speakers, 
will initially be selected 730 and connected 740 to the initial source. Another output 
may also be selected 750, 760, 730. An example of an another output is a VCR 
which may be selected 730 by pressing record button 412 on remote control 400. 
After the desired channel has been selected, the user may change from TV 

15 guide mode to regular television mode by pressing play button 414 on remote control 
400. The screen display changes to a display like that illustrated in Fig. 6B. After a 
few seconds, the information overlay will disappear and the television signal as 
received from the selected source will be displayed without conversion. The 
information overlay illustrated in Fig, 6B can be regenerated for a few seconds by 

20 pressing display button 416 on remote control 400. Note that if it is desired to have 
system 20 work like a conventional television, the initial display can be the television 
mode illustrated in Fig, 6B, rather than TV guide mode as illustrated in Fig. 6A. 
The display can be changed to the TV guide mode by pressing guide button 418. 

In TV guide mode, the display is generated by CPU 26 with the signal from 

25 the selected television channel displayed in a window covering a portion of the screen 
in a conventional manner, as illustrated in Fig. 6A. The user can interact with the 
remainder of the display as a conventional graphical user interface having the screen 
format illustrated in the drawings. For example, an operating system like Windows® 
NT, 95 or 98, or Apple® Mac® OS 9 to generate the screen displays not illustrated in 

30 Fig. 6B, as described in related application Serial No, 09/060,876. As channels are 
selected, a description and an associated image may be displayed as illustrated in Fig. 
6A. The channels displayed on the TV guide may be all available channels, channels 
available from a previously selected source, channels in a previously defined group, 
etc. 
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The "Activelink" button displayed on the screen in Fig. 6A may be selected 
using cursor or mouse control 420 or by pressing E-Link button 422 on remote 
control 400 to access web sites related to the selected program. The initial web site is 
identified by the enhancement table illustrated in Fig. 3B. Subsequent links are 
5 provided from that web site. The enhancement table illustrated in Fig. 3B is 
preferably automatically updated on a subscription or scheduled basis, or by 
information received while connected to a selected channel. The enhancement table 
which is also used in other modes can be updated differently in different modes, as 
described below. 

10 Any of the other sources of input identified on mode select keys 401-410 may 

be selected instead of or simultaneously with the first source. For example, if 
television is selected 710 as the first source and a VCR is selected 750, 760, 730 as a 
second output, simultaneously with output to speakers, connections will be established 
740 by main input audio multiplexer 134 and VCR line output audio multiplexer 130 

15 to route the audio to speaker jacks 158, 160, 168 and VCR jacks 136. Similar 
multiplexers (not shown) in video subsystem 24 route the television signal to video 
inputs of any conventional television monitor and video cassette recorder or other 
recording device (not shown). 

Once the recording of the television program has been started, the user may 

20 select 770, 780, 710 a different mode, such as DVD mode by pressing DVD button 
402. This causes display 720 of a DVD guide for all DVDs previously used with 
system 20, like that illustrated in Fig. 6C. In addition, pressing another mode button 
may cause an immediate selection 730 and connection 740 of the default output, e.g., 
speakers to the new source of input. 

25 If a DVD is placed into the system, or one of the entries in the DVD guide is 

selected and a DVD changer is connected, a screen like that illustrated in Fig. 6D is 
initially displayed. The same screen display is generated when display button 414 is 
pressed. As described above, the video output format (e.g., standard 4:3 or one of 
the letterbox formats), surround sound mode, language, rating, viewing angles, etc. 

30 are read from the database and used to control the DVD player to begin playmg the 
disc without requiring setting by the user each time. 

When radio button 403 is selected, a display screen like that illustrated in Fig. 
6E may be displayed for the station listened to last time hi radio mode. Information 
about the selected station is provided in a text box based on one of the databases 300 

35 (Fig. 4). Other stations may be selected using the buttons below the text box and 
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added to presets displayed on the right. Selection of the " Activelink" button 
displayed on the screen or E-Link button 422 on the remote provides access to the 
web site maintained the selected radio station, or another related web site, such as a 
web site related to a currently playing a song or commercial, where that information 

5 is available in the information stream or a database. 

When guide button 418 is selected in radio mode, a radio guide like that 
illustrated in Fig. 6F may be displayed. Previously defined collections or favorites 
are indicated near the top of the screen and available stations from broadcast bands 
and the Internet are displayed. The display may be ordered by number as illustrated 

10 in Fig. 6D, or any of the other columns by selecting the column heading. Direct 
access is available by pressmg number(s) on the keypad 424 or the cursor or mouse 
controls 420. 

When CD button 407 is selected, a display like that illustrated in Fig. 6G is 
generated for a currently selected compact disc (CD). As illustrated in Fig. 8, a 

15 recording identifier is obtained 805 as described in related applications. Serial Nos. 
09/060,876 and 09/227,086. Database 810 is accessed 815 and if the current 
recording identifier is not found 820, a remote database may be accessed and a record 
created 825 in database 810 for the current recording identifier. The newly created or 
previously stored preferences in database 810 are used 830 as the compact disc begins 

20 to play. Play button 414 and other playback control buttons 430 are used to control 
playback of the CD. 

Compact discs are not the only source of recorded audio that can be played 
back by system 20. When guide button 418 is selected in audio player mode, a 
recorded audio guide like that illustrated in Fig. 6H is displayed from the play list 

25 database illustrated in Fig. 3A. If a playlist is selected that includes 840 one or more 
digitally encoded audio files stored in mass storage 30, system 20 will check 845 that 
a program is stored that can play back 850 the file like a CD using audio preferences, 
such as surround sound effects. System 20 will also automatically update 850 the 
program used to play back files on a subscription or as used basis. 

30 Initially, each CD has an entry in the playlist database with the tracks in the 

order on the CD with default preferences. If there is a change 855 in the audio 
control settings during playback, the preferences in database 810 are updated 860. 
The order of play in the playlist database can be rearranged with tracks deleted from 
play, or a new playlist can be generated with tracks copied from the initial playlist for 

35 the CD. Other playlist can be generated, with names like those illustrated in Fig. 6G 
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with type PL. A play list may have a combination of CD tracks and files stored in 
mass storage 30. As noted above, not only MP3 files, but also other formats that 
digitally encoded audio recordings may be selected for playback in the recorded audio 
guide. 

5 As discussed above with respect to TV mode, record button 412 may be 

pressed in TV, radio and CD modes to start recording of the current selection. A 
default device may be assigned to each source and the user may select a different 
output. For example, in TV mode, when record button 412 is pressed, a portion of 
the screen can be used to display a prompt like "press Record again to begin 
10 recording on VCR 1, or press Options to select a different device." A sunilar screen 
for mitially recording to an audio tape deck may be displayed when in the radio mode. 
The default might be creation of an MP3 file or a CD or mini disc, when in CD 
mode. The list of devices displayed as available for recording are determined by a 
database (not shown) of components connected to system 20. Further options may be 
15 displayed to postpone recording until additional sources are selected, so that input 
Zl sources may be mixed. Also, sources may be added to a recording currently under 

l;3 way for, e.g., voice-over on a video or audio recording, supplied by a microphone 

I i connected to microphone jack 1 14. 

After recording has been selected for one mode, such as a CD to a CD 
20 recorder or a mini disc deck, another mode may be selected while the recording 
p process continues to, e.g., select one VCR for mput and another VCR for output, 

f il Then, another mode, such as TV, radio, Internet browsuig (button 404) or e-mail 

(button 405) may be selected. In the latter modes, a standard computer keyboard (not 
shown) may be used to communicate with system 20 by cable, infrared, or radio 
25 frequency. If a third device, such as another VCR or a digital television recorder is 
available, while the CD and video are copied, a broadcast signal from TV or radio 
may also be recorded. This may include the recording of the video signal from a 
broadcast television program and the audio from a broadcast or Internet station of the 
same event onto a video cassette recorder. 
30 The many features and advantages of the invention are apparent from the 

detailed specification and, thus, it is intended by the appended claims to cover all such 
features and advantages of the invention which fall within the true spirit and scope of 
the invention. Further, since numerous modifications and changes will readily occur 
to those skilled in the art, it is not desired to limit the hivention to the exact 
35 construction and operation illustrated and described, and accordingly all suitable 
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modifications and equivalents may be resorted to, falling within the scope of the 
invention. 
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CLAIMS 

What is claimed is: 

1 . A method of playing back a recorded signal, comprising: 

obtaining a recording identifier corresponding to the recorded signal; 

comparing the recording identifier with previously stored identifiers in 
a playback preference database; and 

reproducing the recorded signal using previously stored preferences if 
the recording identifier is found in the playback preference database and using default 
preferences if the recording identifier is not found in the playback preference 
database. 

2. A method as recited in claim 1, further comprising: 

obtaining playback preferences during said reproducing; and 
storing the playback preferences in the playback preference database. 

3. A method as recited in claim 2, wherein the playback preferences include 
audio control settings. 

4. A method as recited in clahn 3, wherein the audio control settmgs include 
programmable effects, 

5. A method as recited in claim 4, further comprising obtaining the recorded 
signal from a compact disc. 

6. A method as recited in claim 4, further comprising obtaining the recorded 
signal from a file of digitally encoded audio on a computer readable medium. 
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6. A method as recited in claim 4, further comprising obtaining the recorded 
signal from a file of digitally encoded audio on a computer readable medium. 



7. A method as recited in claim 6, wherein the file of digitally encoded using 
ISO-MPEG Audio Layer-3. 

8. A method as recited in claim 6, 

wherein the computer readable medium is a computer mass storage 

device, and 

wherein said method further comprises: 

detecting changes in software available to playback the recorded 

signal, and 

automatically downloading the software to playback the 

recorded signal. 

9. A method as recited in claim 4, wherein the programmable effects are 
surround sound effects. 

10. A method as recited in claim 3, wherein the audio control settings include 
at least one of echo, reverberation, loudness, speed and direction, 

11. A method as recited in claim 2, further comprising obtaining the recorded 
signal from a digital versatile disc. 

12. A method as recited in claim 11, wherein the playback preferences include 
at least one of audio and video control settmgs. 

13. A method as recited in claim 12, wherein the playback preferences include 
surround sound mode. 

14. A method as recited in claun 12, wherein the playback preferences include 
language of audio in the recorded signal. 

15. A method as recited in claun 12, wherein the playback preferences include 
content rating. 
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16. A method as recited in claim 12, wherein the playback preferences include 
at least one viewing angle. 

17. A method as recited in claim 12, wherein the playback preferences include 
video output mode. 

18. A method as recited in claim 11, 

wherein the default preferences mclude at least one of surround sound 
mode, language of audio in the recorded signal, and video output format, and 

wherein as many of the default preferences are used as available on the 
digital versatile disc if the recording identifier is not found in the playback preference 
database. 

19. At least one computer program stored on a computer-readable medium, 
embodying a method of playing back a recorded signal, comprising: 

obtaining a recording identifier corresponding to the recorded signal; 

comparing the recording identifier with previously stored identifiers in 
a playback preference database; and 

reproducing the recorded signal using previously stored preferences if 
the recording identifier is found in the playback preference database and using default 
preferences if the recording identifier is not found in the playback preference 
database. 

20. At least one computer program as recited in claim 19, further comprising: 

obtaining playback preferences during said reproducing; and 
storing the playback preferences in the playback preference database. 

21. At least one computer program as recited in claim 20, wherein the 
playback preferences include audio control settings, 

22 At least one computer program as recited in claim 21, wherein the audio 
control settings include programmable effects. 

23. At least one computer program as recited in claim 22, further comprising 
obtaining the recorded signal firom a compact disc. 
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24. A method as recited in claim 22, further comprising obtaining the 
recorded signal from a file of digitally encoded audio on a computer readable 
medium. 

25. At least one computer program as recited in claim 24, wherein the file of 
digitally encoded using ISO-MPEG Audio Layer-3. 

26. At least one computer program as recited in claim 24, 

wherein the computer readable medium is a computer mass storage 

device, and 

wherein said method further comprises: 

detecting changes in software available to playback the recorded 

signal, and 

automatically downloading the software to playback the 

recorded signal. 

27. At least one computer program as recited in clahn 22, wherein the 
programmable effects are surround sound effects. 

28. At least one computer program as recited in claim 21, wherein the audio 
control settings include at least one of echo, reverberation, loudness, speed and 
direction. 

29. At least one computer program as recited in clahn 20, fiirther comprising 
obtaining the recorded signal from a digital versatile disc. 

30. At least one computer program as recited in clahn 29, wherein the 
playback preferences include at least one of audio and video control settings. 

31. At least one computer program as recited in claim 30, wherein the 
playback preferences include surround sound mode. 

32. At least one computer program as recited in clakn 30, wherein the 
playback preferences include language of audio in the recorded signal. 
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33. At least one computer program as recited in claim 30, wherein the 
playback preferences include content rating. 

34. At least one computer program as recited in claim 30, wherein the 
playback preferences include at least one viewing angle. 

35. At least one computer program as recited in claim 30, wherein the 
playback preferences include video output mode. 

36. At least one computer program as recited in claim 29, 

wherein the default preferences include at least one of surround sound 
mode, language of audio in the recorded signal, and video output format, and 

wherein as many of the default preferences are used as available on the 
digital versatile disc if the recording identifier is not found in the playback preference 
database. 

37. At least one database stored on a computer-readable medium, comprising: 

a playlist identifier for each playlist; 

an order within the playlist for a recorded signal; 

a disc identifier when the recorded signal is obtained from a digitally 

encoded disc; 

a filename when the recorded signal is obtained from a digitally 
encoded file on a mass storage device; and 

playback preferences for reproducing the recorded signal. 

38. At least one database stored on a computer-readable medium as recited in 
claim 37, further comprising a table containing playlist records, each playlist record 
including the playlist identifier. 

39. At least one database stored on a computer-readable medium as recited in 
claim 38, further comprising a plurality of song records containing identical playlist 
identifiers and different order values, with a first song record containing the disc 
identifier and a second song record containing the filename. 
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40. At least one database stored on a computer-readable medium as recited in 
claim 39, wherein each playlist record further comprises 

an image filename; 
a content producer; and 
a genre descriptor. 

41. At least one database stored on a computer-readable medium as recited in 
claim 39, 

wherein said song records further include a track number, and 
wherein said at least one database further comprising a plurality of 
records containing 

the disc identifier in one of the song records; 
the track number in the one of the song records; 
amount of a track to play; and 
playback preferences for the track, 

42. At least one database stored on a computer-readable medium as recited in 
claim 41, wherein the playback preferences include at least one of surround sound 
mode, echo, reverberation, loudness, speed and direction. 

43. At least one database stored on a computer-readable medium as recited in 
claim 41, 

wherein the recorded signal includes video content, and 
wherein the playback preferences include at least one of surround 
sound mode, language of audio in the recorded signal, and video output format. 

44. At least one database stored on a computer-readable medium as recited in 
claim 43, 

wherein the recorded signal is obtamed from a digital versatile disc in a 
playback device, and 

wherein said at least one database stores more disc identifiers than 
stored in the playback device. 

45. A method of controlling audio/video devices, comprising: 



-22- 1364.1007 

selecting a first source from among inputs including at least two of a 
computer file, a computer data connection, a digitally encoded disc player, a radio 
tuner, a television audio decoder, an MPEG decoder, a S/PDIF input, a microphone, 
an external video signal and an external audio signal; 

selecting a first output for the first source from among outputs 
including a computer mass storage device and at least one of speakers, headphones, an 
audio tape device, and a video tape device; and 

routing the first source to the first output. 

47. A method as recited in claim 45, further comprising: 

selecting a second source of input from among the inputs not selected 
as the first source; 

selecting a second output from among the outputs not selected for the 
first output; and 

routing the second source to the second output. 

48. A method as recited in claim 45, further comprising: 

selecting a second source of input from among the inputs not selected 
as the first source; and 

mixing the first and second sources of input prior to routing both to the 

first output. 

49. A method as recited in claim 45, further comprising: 

selecting up to three additional sources of input; 

determining amount of mixing of the first source and the three 
additional sources; and 

routing the first source and the three additional sources to the first 
output and up to three additional outputs with the amount of mixing previously 
determined. 



50, 



A method as recited in claim 45, 

wherein said selecting selects an audio only source as the first source, 
wherein said routing routes the first source to said speakers, and 
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wherein said method further comprises routing a video signal from a 
5 video source to a video output device simultaneously with said routing of the first 
source to said speakers, 

5L An apparatus controlling audio/ video devices, comprising: 

a source selection circuit to select a first source from among inputs 
including at least two of a computer file, a computer data connection, a digitally 
encoded disc player, a radio tuner, a television audio decoder, an MPEG decoder, a 
5 S/PDIF input, a microphone, an external video signal and an external audio signal; 

an output selection circuit to select a first output for the first source 
from among outputs including a computer mass storage device and at least one of 
speakers, headphones, an audio tape device, and a video tape device; and 

a multiplexer circuit to route the first source to the first output. 

52. A method of providing a graphical user interface for an audio/video 
control device, comprising: 

receiving a source selection signal from a remote control identifying a 
selected source from among at least two of a playlist database, a computer data 
5 connection database, a digitally encoded disc player, a radio tuner, a television audio 
decoder, an MPEG decoder, a S/PDIF input, a microphone, an external video signal 
and an external audio signal; 

displaying on a video display device a first graphical user interface for 
the selected source; 

10 receiving user commands indicating control operations of the selected 

source; 

translating the user commands into device conomands for the selected 

source; and 

transmitting the device commands to the selected source. 

53. A method as recited in claim 52, further comprising: 

receiving a new source selection signal from the remote control 
identifying a newly selected source; 

displaying on the video display device a second graphical user interface 
5 for the newly selected source; 
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receiving new user commands indicating control operations of the 
newly selected source; 

translating the new user commands into new device commands for the 
newly selected source; and 

transmitting the new device commands to the newly selected source. 

54. A method as recited in clann 32, further comprising: 

receiving a destination identification signal from the remote control 
identifying a destination device for signals from the selected source; 

automatically issuing commands to control the destination device; and 
routing the signals from the selected source to the destination device. 
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PLAYBACK DEVICE HAVING TEXT DISPLAY AND 
COMMUNICATION WITH REMOTE DATABASE OF TITLES 

ABSTRACT OF THE DISCLOSURE 

Control of audio/video equipment is provided by an apparatus constructed like 
a computer, with audio and video subsystems. The audio subsystem includes a 
programmable analog mixer and several analog and digital multiplexers to route and 
mix multiple inputs to multiple outputs. Databases are stored in computer mass 
storage to record preferences for playback of digital versatile discs, compact discs and 
audio files stored in the mass storage device, such as MPS files. The playback 
preferences may include video output format, language, surround sound mode, etc. 
for DVDs and surround sound effects for CDs and audio files. 
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